Physician and patient concordance in reporting of appropriateness and prioritization for cataract surgery.

BACKGROUND/AIMS: Determine the association between physician-deemed and patient-reported appropriateness and prioritization for cataract surgery. METHODS: Prospective cohort study of 471 patients of 7 ophthalmologists referred for cataract surgery. Ophthalmologists rated patients for cataract surgery appropriateness and prioritization using a visual analogue scale of 0-10 preoperatively. All patients completed the eCAPS Quality of Life (QoL), while 313 completed the Catquest-9SF and EQ-5D questionnaires. Regression analyses were applied to determine demographic, clinical and patient-reported outcome measures (PROMs) associated with appropriateness and prioritization. RESULTS: Two clinical factors (study eye and fellow eye best-corrected visual acuity (BCVA)), 2 eCAPS (night driving difficulty, ability to take care of local errands), and 2 Catquest-9SF PROMs (recognizing faces, seeing to walk on uneven ground) were associated with appropriateness. In multivariable regression, the rating physician, 2 clinical criteria (study eye BCVA, anticipated postoperative BCVA) and 1 eCAPS QoL (night driving difficulty) were associated with appropriateness. Prioritization was associated with low income, 8 clinical criteria, 9 eCAPS, 5 Catquest-9SF, and 1 EQ-5D PROMs. In multivariable regression, 1 clinical criterion (study eye BCVA), 2 eCAPS QoL (night driving difficulty, ability to take care of local errands), and 2 Catquest-9SF PROMs (seeing prices, seeing to walk on uneven ground) were significantly associated. CONCLUSIONS: The eCAPS and Catquest-9SF questionnaires show some concordance with physician-deemed appropriateness, and more with prioritization. Binary conversions of PROM scales provide similar modelling, with minimal loss of explanatory power. As physician-deemed appropriateness and prioritization do not completely capture the patient perspective, PROMs may have a role in cataract surgery decision-making frameworks.

A transition point for the blood flow wall shear stress environment in the human fetal left ventricle during early gestation.

Development of the fetal heart is a fascinating process that involves a tremendous amount of growth. Here, we performed image-based flow simulations of 3 human fetal left ventricles (LV), and investigated the hypothetical scenario where the sizes of the hearts are scaled down, leading to reduced Reynolds number, to emulate earlier fetal stages. The shape and motion of the LV were retained over the scaling to isolate and understand the effects of length scaling on its fluid dynamics. We observed an interesting cut-off point in Reynolds number (Re), across which the dependency of LV wall shear stress (WSS) on Re changed. This was in line with classical fluid mechanic theory where skin friction coefficient exhibited first a decreasing trend and then a plateauing trend with increasing Re. Below this cut-off point, viscous effects dominated, stifling the formation of LV diastolic vorticity structures, and WSS was roughly independent of Reynolds number. However, above this cut-off, inertial effects dominated to cause diastolic vortex ring formation and detachment, and to cause WSS to scale linearly with Reynolds number. Results suggested that this transition point is found at approximately 11 weeks of gestation. Since WSS is thought to be a biomechanical stimuli for growth, this may have implications on normal fetal heart growth and malformation diseases like Hypoplastic Left Heart Syndrome.

Predicting changes in cataract surgery health outcomes using a cataract surgery appropriateness and prioritization instrument.

OBJECTIVE: Determine whether items in a cataract surgery appropriateness and prioritization questionnaire can predict change in best corrected visual acuity (BCVA) and health related quality of life (HRQOL) following cataract surgery. METHODS: 313 patients with a cataract in Ontario, Canada were recruited to participate. BCVA was measured using the Snellen chart. HRQOL was measured using a generic instrument (EQ5D), a visual functioning instrument (Catquest-9SF), and an appropriateness and prioritization instrument (17 items). Outcomes were measured preoperatively and 3-6 months postoperatively. Descriptive statistics were used to describe demographics and outcomes. For each appropriateness and prioritization questionnaire item, a one-way ANOVA was used to compare group means of the change in BCVA, EQ5D, and Catquest-9SF. RESULTS: Participants had a mean age of 69 years and were 56% female. BCVA improved in 81%, EQ5D in 49.6%, and Catquest-9SF score in 84% of patients. Improvement in both BCVA and Catquest-9SF scores were found in 68.5% of patients. The ANOVA showed a statistically significant association between a change in BCVA and the ability to participate in social life, and a statistically significant association between a change in Catquest-9SF and glare, extent of impairment in visual function, safety and injury concerns, ability to work and care for dependents, ability to take care of local errands, ability to assist others and ability to participate in social life. CONCLUSIONS: Almost all patients had improved BCVA and/or visual functioning after surgery. Seven variables from the cataract appropriateness and prioritization instrument were found to be predictors of improvement in Catquest-9SF measuring visual functioning.

Catquest-9SF questionnaire and eCAPS: Validation in a Canadian population.

BACKGROUND: Visual acuity alone has limitations in assessing a patient's appropriateness and prioritization for cataract surgery. Several tools, including the Catquest-9SF questionnaire and the electronic cataract appropriateness and priority system (eCAPS) have been developed to evaluate patients-reported visual function as related to day-to-day tasks. The aim of this study was to validate Catquest-9SF and eCAPS in a Canadian population and propose a shorter version of each, in an attempt to extend their applicability in clinical practice. METHODS: The English translation of the Swedish Catquest-9SF and eCAPS were self-administered separately in pre-operative patients in tertiary care in Peel region, Ontario. Rasch analysis was used to validate both scales and assess their psychometric properties, such as category threshold order, item fit, unidimensionality, precision, targeting, and differential item functioning. RESULTS: A total of 313 cataract patients (mean age = 69.1, 56.5% female) completed the Catquest-9SF and eCAPS. Catquest-9SF had ordered response thresholds, adequate precision (person separation index = 2.09, person reliability = 0.81), unidimensionality and no misfits (infit range 0.75-1.35, outfit range 0.83-1.36). There mean for patients was equal to -1.43 (lower than the mean for items which is set automatically at zero), meaning that tasks were relatively easy for respondent ability. eCAPS had 3 items that misfit the Rasch model and were excluded (infit range 0.82-1.30, outfit range 0.75-1.36). Precision was inadequate (person separation index = 0.19, person reliability = 0.04). 78.8% of subjects scored≤9 (answered that they had no issues for most questions). CONCLUSIONS: Catquest-9SF demonstrated good psychometric properties and is suitable for assessing visual function of care-seeking patients referred for cataract surgery in Ontario, Canada. There was some mistargeting, suggesting that the tasks were relatively easy to perform, which is consistent with previous research. On the contrary, eCAPS is not sensitive in differentiating patients who had impaired visual functioning.

Development and Reliability of an Appropriateness and Prioritization Instrument for Eye Care Practice: A Modified Delphi Process.

Purpose: To modify the Western Canada Waiting List Project (WCWLP) cataract prioritization criteria into measurement instruments for assessing appropriateness and prioritization emphasizing health-related quality of life (HRQoL) and examining reliability.Methods: A modified Delphi process was conducted using two rounds of online surveys and a face-to-face meeting. A panel of eye care experts rated the relevancy of criteria on a 5-point scale. Patient narratives highlighted the patient experience. A G-theory framework was used to assess inter- and intra-rater agreement using the criteria.Results: Nine Ophthalmologists, three Optometrists, and one General Practitioner participated in the modified Delphi process. Consensus to include/exclude was reached on all criteria. Seventeen criteria were included and 16 were excluded. The most significant changes were related to the categorization of comorbidities and expansion of HRQoL questions. The overall reliability was good (ϕ = 0.852).Conclusion: The WCWLP was modified to include appropriateness and to better reflect HRQoL. Having achieved consensus and demonstrated reliability of the criteria, the next step is to estimate weights for criteria and to validate against patient health outcomes data.

Using an electronic tool to improve teamwork and interprofessional communication to meet the needs of complex hospitalized patients: A mixed methods study.

BACKGROUND: Teamwork and interprofessional communication are important in addressing the comprehensive care needs of complex hospitalized patients. The objective of this study is to evaluate the impact of an electronic interprofessional communication and collaboration platform on teamwork, communication, and adverse events in the hospital setting. MATERIALS AND METHODS: In this mixed methods study, we used a quasi-experimental design in the quantitative component and deployed the electronic tool in a staged fashion to 2 hospital wards 3 months apart. We measured teamwork, communication, and adverse events with Relational Coordination survey, video recordings of team rounds, and retrospective chart review. We conducted qualitative semi-structured interviews with clinicians to understand the perceived impacts of the electronic tool and other contextual factors. RESULTS: Teamwork sustainably improved (overall Relational Coordination score improved from 3.68 at baseline to 3.84 at three and six months after intervention, p = 0.03) on ward 1. A small change in face-to-face communication pattern during team rounds was observed (making plans increased from 22% to 24%, p = 0.004) at 3 months on ward 1 but was not sustained at 6 months. Teamwork and communication did not change after the intervention on ward 2. There was no meaningful change to adverse event rates on either ward. Clinicians reported generally positive views about the electronic tool's impact but described non-technology factors on each ward that affected teamwork and communication. CONCLUSION: The impact of using an electronic tool to improve teamwork and communication in the hospital setting appears mixed, but can be positive in some settings. Improving teamwork and communication likely require both appropriate technology and addressing non-technology factors.

Clinician user involvement in the real world: Designing an electronic tool to improve interprofessional communication and collaboration in a hospital setting.

OBJECTIVES: User involvement is vital to the success of health information technology implementation. However, involving clinician users effectively and meaningfully in complex healthcare organizations remains challenging. The objective of this paper is to share our real-world experience of applying a variety of user involvement methods in the design and implementation of a clinical communication and collaboration platform aimed at facilitating care of complex hospitalized patients by an interprofessional team of clinicians. METHODS: We designed and implemented an electronic clinical communication and collaboration platform in a large community teaching hospital. The design team consisted of both technical and healthcare professionals. Agile software development methodology was used to facilitate rapid iterative design and user input. We involved clinician users at all stages of the development lifecycle using a variety of user-centered, user co-design, and participatory design methods. RESULTS: Thirty-six software releases were delivered over 24 months. User involvement has resulted in improvement in user interface design, identification of software defects, creation of new modules that facilitated workflow, and identification of necessary changes to the scope of the project early on. CONCLUSION: A variety of user involvement methods were complementary and benefited the design and implementation of a complex health IT solution. Combining these methods with agile software development methodology can turn designs into functioning clinical system to support iterative improvement.

The impact of team based interprofessional comprehensive assessments on the diagnosis and management of diabetic foot ulcers: A retrospective cohort study.

BACKGROUND: Diabetic foot ulcers (DFU) are increasingly prevalent, and associated with significant morbidity, mortality, and cost. An interprofessional approach to DFU management is critical given the etiological complexity involved. This study aimed to assess the impact of an interprofessional team approach on DFU diagnosis and management for a cohort of patients receiving treatment in an Ontario Canada home care setting. METHODS: A retrospective cohort study of patients attending a large regional Community Care Access Centre (CCAC) between February 11, 2013-September 30, 2014 was conducted. Following CCAC referral, patients were assessed by an interprofessional team at the Toronto Regional Wound Healing Centre (TRWHC). Those aged > 18 years with a DFU of > 6 weeks duration were included. The primary outcome was the precision of the initial diagnosis relating to DFU etiology (i.e. neuropathic, ischemic or mixed etiology). Secondary outcomes included wound healing, and infection parameters. Analysis was completed with STATA 13.1 (College Stn., TX) of pre-determined outcomes with 2 sided α of 0.05. RESULTS: A total of 308 patients were screened, and 49 patients (67.3% male) of mean age 64.2 years (SD 13.7) with a diagnosis of DFU > 6 weeks duration were included for analysis. Of these, 95% were referred with unspecified DFU, and were reclassified to a precise diagnosis relating to etiology, including neuropathy, ischemia or neuroischemic etiology following TRWHC assessment (p < 0.001). For secondary outcomes post-assessment, healability assessment was conducted for a greater proportion of patients (100% versus 44%, p < 0.001). Infection was identified in a greater number of patients (p = 0.04), and of the 35 patients, 94.5% had deep and surrounding infection, and 88.0% were initiated on systemic antibiotics. Vascular insufficiency was diagnosed in an additional 14.3% of the cohort (p = 0.03). Offloading/footwear assessment was conducted in all patients compared with 30.6% prior to referral (p < 0.001) Dressing change frequency decreased significantly following TRWHC assessment (pre: 4.31/week; post: 3.54/week; p = 0.03). Pain scores decreased (2.18 to 1.67) on the numerical rating scale but this was not statistically significant at the final TRWHC assessment. Notably, 36.7% (18/49) reported improved quality of life by the second TRWHC encounter. CONCLUSIONS: Interprofessional care teams are associated with improved diagnostic acumen and wound healing outcomes over conventional community care services. Initiatives including best practice interprofessional diabetic foot care pathways are recommended with timely vascular management of ischemia, treatment of deep and surrounding infection as well as the availability of foot care and footwear.

Access to surgery for paediatric patients with medically refractory epilepsy: a systems analysis.

PURPOSE: A systems analysis perspective was undertaken to evaluate access to surgery for children with medically refractory epilepsy (MRE) in Ontario, the largest province in Canada. The analysis focused on the assessment of referral patterns, healthcare utilization, time intervals and patient flow to determine surgical candidacy in children with MRE. The purpose of this systems analysis study was to identify rate limiting steps that may lead to delayed surgical candidacy decision and surgery. METHODS: Prolonged video electroencephalography (vEEG) is the common entry point into the process for all potential epilepsy surgery candidates. Therefore, a single centre retrospective chart review of children and adolescents referred to the epilepsy monitoring unit (EMU) for vEEG monitoring at the primary referral centre for paediatric epilepsy surgery in the province. Basic demographic and referral data were abstracted for all screened cases. Included cases were: (1) age <19 years old at time of first EMU admission, (2) date of EMU admission between April 1, 2004 and March 31, 2006 and (3) referral for elective vEEG and/or overnight with vEEG greater than 8h duration. Data were collected on number of seizure conferences, surgical candidacy, surgical outcomes (seizure free and seizure reduction), resource utilization, and recorded time stamps for each event to estimate system delays. RESULTS: During the two-year period, 463 patients were referred to the EMU of whom 349 received prolonged vEEG (>8h). Forty five percent (n=160) of patients came to seizure conference for discussion of their data, of whom 40% (64/160) were considered surgical candidates. Time from first seizure to EMU referral was approximately 4.6 years. Time from referral to admission and admission to first seizure conference were approximately 103 days and 71 days, respectively. From initial EMU referral to surgery ranged from 1.6 to 1.1 years depending on whether the patient required invasive monitoring with intracranial EEG. Overall, 95% of surgical patients had a reduction in seizure frequency, 74% were seizure free after one year post-surgery. SIGNIFICANCE: Referral rates for surgical assessment are low relative to the estimated number of children living with MRE in Ontario, less than 2%. Hence, only a limited number of children with this disorder in the province of Ontario who could benefit from epilepsy surgery are being assessed for surgical candidacy. The majority of Ontario children with MRE are not being provided the potential opportunity to be seizure free and live without functional limitations following surgical intervention. These data document the critical need for health system redesign in Ontario, the goal of which should be to provide more consistent and just access to evidence-based medical and surgical care for those citizens of the province who suffer from epilepsy.

Simulating an emergency department: the importance of modeling the interactions between physicians and delegates in a discrete event simulation.

BACKGROUND: Computer simulation studies of the emergency department (ED) are often patient driven and consider the physician as a human resource whose primary activity is interacting directly with the patient. In many EDs, physicians supervise delegates such as residents, physician assistants and nurse practitioners each with different skill sets and levels of independence. The purpose of this study is to present an alternative approach where physicians and their delegates in the ED are modeled as interacting pseudo-agents in a discrete event simulation (DES) and to compare it with the traditional approach ignoring such interactions. METHODS: The new approach models a hierarchy of heterogeneous interacting pseudo-agents in a DES, where pseudo-agents are entities with embedded decision logic. The pseudo-agents represent a physician and delegate, where the physician plays a senior role to the delegate (i.e. treats high acuity patients and acts as a consult for the delegate). A simple model without the complexity of the ED is first created in order to validate the building blocks (programming) used to create the pseudo-agents and their interaction (i.e. consultation). Following validation, the new approach is implemented in an ED model using data from an Ontario hospital. Outputs from this model are compared with outputs from the ED model without the interacting pseudo-agents. They are compared based on physician and delegate utilization, patient waiting time for treatment, and average length of stay. Additionally, we conduct sensitivity analyses on key parameters in the model. RESULTS: In the hospital ED model, comparisons between the approach with interaction and without showed physician utilization increase from 23% to 41% and delegate utilization increase from 56% to 71%. Results show statistically significant mean time differences for low acuity patients between models. Interaction time between physician and delegate results in increased ED length of stay and longer waits for beds. CONCLUSION: This example shows the importance of accurately modeling physician relationships and the roles in which they treat patients. Neglecting these relationships could lead to inefficient resource allocation due to inaccurate estimates of physician and delegate time spent on patient related activities and length of stay.

Transferability of health technology assessments and economic evaluations: a systematic review of approaches for assessment and application.

BACKGROUND: Health technology assessments (HTA) generally, and economic evaluations (EE) more specifically, have become an integral part of health care decision making around the world. However, these assessments are time consuming and expensive to conduct. Evaluation resources are scarce and therefore priorities need to be set for these assessments and the ability to use information from one country or region in another (geographic transferability) is an increasingly important consideration. OBJECTIVES: To review the existing approaches, systems, and tools for assessing the geographic transferability potential or guiding the conduct of transferring HTAs and EEs. METHODS: A systematic literature review was conducted of several databases, supplemented with web searching, hand searching of journals, and bibliographic searching of identified articles. Systems, tools, checklists, and flow charts to assess, evaluate, or guide the conduct of transferability of HTAs and EEs were identified. RESULTS: Of 282 references identified, 27 articles were reviewed in full text and of these, seven proposed unique systems, tools, checklists, or flow charts specifically for geographic transferability. All of the seven articles identified a checklist of transferability factors to consider, and most articles identified a subset of 'critical' factors for assessing transferability potential. Most of these critical factors related to study quality, transparency of methods, the level of reporting of methods and results, and the applicability of the treatment comparators to the target country. Some authors proposed a sequenced flow chart type approach, while others proposed an assessment of critical criteria first, followed by an assessment of other noncritical factors. Finally some authors proposed a quantitative score or index to measure transferability potential. CONCLUSION: Despite a number of publications on the topic, the proposed approaches and the factors used for assessing geographic transferability potential have varied substantially across the papers reviewed. Most promising is the identification of an extensive checklist of critical and noncritical factors in determining transferability potential, which may form the basis for consensus of a future tool. Due to the complexities of identifying appropriate weights for each of the noncritical factors, it is still uncertain whether the assessment and calculation of an overall transferability score or index will be practical or useful for transferability considerations in the future.

General population versus disease-specific event rate and cost estimates: potential bias for economic appraisals.

Economic appraisals are increasingly being used for reimbursement decision making. Differences exist in the population data sources used in different studies and these differences may result in errors or biased estimates. A review of the literature suggests that very little has been written on this topic and guidelines and good practice documents are silent on the issue. Using illustrative examples, it was found that the population chosen for event/complication costing did not have a large impact on a cost-effectiveness analysis; however, the choice of population did have a large impact for cost-of-illness (COI) estimation. It was found that not controlling for event/complication rates in a nondiseased population resulted in a 15% inflated COI estimate and using event costs from the general population underestimated COI by 20-32%. Our analysis suggests that using event costs from the general population instead of a diseased population may not have a significant impact on cost-effectiveness estimates; however, COI studies should only use excess event/complication rates and should also only use event costs from populations with the disease.

Impact of the 1997 Canadian guidelines on the conduct of Canadian-based economic evaluations in the published literature.

OBJECTIVE: To assess the impact of the 1997 Canadian guidelines on the methods and presentation of economic evaluations conducted from a Canadian perspective in the published literature. METHODS: A systematic literature review was conducted to identify health technology economic evaluations conducted from a Canadian perspective published in peer-reviewed journals between 2001 and 2006. To investigate the impact of the 1997 Canadian Coordinating Office of Health Technology Assessment guidelines, each included study was assessed against 17 of the 25 recommendations. RESULTS: Of the 153 included studies, a base set of 9 methodological standards, as outlined by the 1997 guidelines, were followed by over 50% of the studies including: indications, outcomes for cost utility analysis, outcomes for cost benefit analysis, discounting future cost and outcomes, cost identification and valuation, evaluating uncertainty and disclosing funding relationships. Main divergences from the guidelines were found for analytic technique (38%), study perspective (23%), source of preferences (8%), equity (7%), and cost measurement (24%). CONCLUSION: The current assessment has shown that the 1997 Canadian guidelines have set a minimum methodological standard within the community of "doers" conducting economic analyses from a Canadian perspective. Although there was divergence from some of the recommendations, the majority were reflected as changes in the 2006 Canadian guidelines.

A review of the cost of cardiovascular disease.

In Canada, 74,255 deaths (33% of all deaths) in 2003 were due to cardio-vascular disease (CVD). As one of the most costly diseases, CVD represents a major economic burden on health care systems. The purpose of the present study was to review the literature on the economic costs of CVD in Canada and other developed countries (United States, Europe and Australia) published from 1998 to 2006, with a focus on Canada. Of 1656 screened titles and abstracts, 34 articles were reviewed including six Canadian studies and 17 American studies. While considerable variation was observed among studies, all studies indicated that the costs of treating CVD-related conditions are significant, outlining a convincing case for CVD prevention programs.

Health technology assessment for radiologists: basic principles and evaluation framework.

Decision makers are faced with the task of allocating health resources to maximize patients' health under budget constraints. To offer structure to the complexity of the decision-making process, the field of health technology assessment (HTA) was developed. This paper offers an introduction to the fundamental aspects of HTA and acts as a guide to the conduct of HTA for radiologists. First, the authors define HTA and describe how it is linked to the field of diagnostics. Second, a basic 11-step framework for the conduct of an HTA is outlined. The framework begins with the identification of the problem and proceeds through to the dissemination and impact of an HTA. Third, the authors provide a real-world example of an HTA in the field of diagnostics. Last, they describe the challenges and barriers faced in HTA.

Approaches for economic evaluations of health care technologies.

Economic evaluations involve the comparison of alternative courses of action in terms of both their costs and their consequences. In response to increasing health care costs, economic evaluations of competing technologies, including radiologic interventions, are increasingly used to inform resource allocation decisions. It is therefore crucial that radiologists have a thorough understanding of the methods. The objective of this paper is to present a detailed overview of the principles and methods of economic evaluations of health technologies, including recent methodologic developments. For the purpose of this paper, the key elements of an economic evaluation are divided into 5 broad sections: 1) types of economic evaluations (eg, cost-effectiveness analysis, cost-utility analysis), 2) study perspectives (ie, temporal and cost perspectives), 3) analysis of costs and effects (eg, incremental cost-effectiveness ratios, cost-effectiveness planes), 4) conducting economic evaluations alongside trials or using decision-analytic models, and 5) dealing with the different forms of uncertainty in economic evaluations (eg, sampling uncertainty in trials, parameter uncertainty in models). Examples from the recent radiology literature are used to explain the key concepts. This review improves upon the previous educational papers published in radiologic journals, as it covers recent methodologic advances regarding the treatment of uncertainty.

Health technology assessment from a Canadian device industry perspective.

Health technology assessment has significantly improved the decision-making process via the thorough and systematic evaluation of the clinical utility and cost-effectiveness of new drugs and health technologies. However, the device industry faces a significant challenge in meeting the evidentiary demands of the health technology assessment process, particularly given the small size of the Canadian market and device manufacturers. This is further compounded by the somewhat short-sighted nature of health care budgets, which see medical devices as a cost-driver given the sometimes significant upfront investment required to implement a technology producing downstream benefits in the long-term. Industry is the research and development of the health care system, but innovative development could be stifled unless the health technology assessment process recognizes the risk of manufacturers. The authors propose that health technology assessment can be improved by recognizing the challenges that device manufacturers face and by sharing the risk associated with evaluations of effectiveness. Health technology assessment is a powerful tool that can be used to evaluate new and potentially obsolete technologies alike, with the goal of meeting the needs of patients as customers of both the device industry and the health care system.

In search of the evidentiary foundation of published Canadian economic evaluations (2001-06).

OBJECTIVES: The aim of this study was to present a review of economic evaluations conducted from a Canadian perspective and to characterize sources of evidence and statistical methods to analyze effectiveness measures, resource utilization, and uncertainty. METHODS: A search strategy was developed to identify Canadian economic evaluations published between January 2001 and June 2006. A standardized abstraction form was used to extract key data (e.g., study design, data sources, statistical methods). RESULTS: A total of 153 unique studies were included for review, of which 75 were evaluations of drug therapies and less than half were funded by industry. Cost-effectiveness analysis was the most common type of economic evaluation and 80 percent of the studies used modeling techniques. A single source of evidence for effectiveness measures was used in half of the studies. Statistical methods were commonly reported to compare effectiveness measures when the economic evaluation was conducted alongside a clinical trial but less commonly when determining effectiveness input parameters in model-based economic evaluations, or to analyze resource utilization data. Authors relied mostly on univariate sensitivity analyses to explore uncertainty. CONCLUSIONS: This review identifies the need to improve the conduct and reporting of statistical methods for economic evaluations to improve confidence in the results.

Economic evaluations conducted by Canadian health technology assessment agencies: where do we stand?

OBJECTIVES: To examine the production of Health Technology Assessments (HTAs) with economic evaluations (EEs) conducted by Canadian HTA agencies. METHODS: This research used a three-step approach: (i) the Web sites of five Canadian organizations promoting HTA were searched to identify HTA reports with EEs; (ii) HTA agencies were surveyed to verify that our information was complete with respect to HTA activities and to describe the factors that influence the HTA process in Canada (i.e., selection of HTA topics, execution, dissemination of results and future trends); (iii) HTAs with EEs were appraised in terms of study design, retrieval of clinical and economic evidence, resource utilization and costing, effectiveness measures, treatment of uncertainty as well as presence of a budget impact analysis (BIA), and policy recommendations. RESULTS: Two hundred forty-nine HTA reports were identified of which 19 percent included EEs (n = 48). Decision analytic techniques were used in approximately 75 percent of the forty-eight EEs and probabilistic sensitivity analyses were commonly used by all agencies to deal with parameter uncertainty. BIAs or policy recommendations were given in 50 percent of the evaluations. Differences between agencies were observed in terms of selection of topics, focus of assessment and production of HTA (e.g., in-house activities). Major barriers to the conduct of HTAs with EEs were capacity, a lack of interest by decision makers and a lack of robust clinical information. CONCLUSIONS: The results of this research point to the need for increased HTA training, collaboration, evidence synthesis, and use of pragmatic "real world" evaluations.